Papers with enhanced domain adaptation
Instruction-Tuning Data Synthesis from Scratch via Web Reconstruction (2025.findings-acl)
Copied to clipboard
Yuxin Jiang, Yufei Wang, Chuhan Wu, Xinyi Dai, Yan Xu, Weinan Gan, Yasheng Wang, Xin Jiang, Lifeng Shang, Ruiming Tang, Wei Wang
| Challenge: | Existing methods for generating and curating high-quality instruction-tuning data rely heavily on the quality of seed data or strong assumptions about the structure and content of web documents. |
| Approach: | They propose a fully automated framework for synthesizing high-quality instruction-tuning (IT) data directly from raw web documents with minimal assumptions. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines by 16.65% across four instruction-following benchmarks. |